Digital document editing method, digital document editing program and digital document editing apparatus

ABSTRACT

The invention relates to an editing of a digital document containing an image, a text, a pattern and the like on pages constituting the digital document. In response to an operation for deleting an image positioned in a page, such image is not added to another page but is moved to and displayed in an evacuation area provided independently from the page area. In the evacuation area, such image is displayed together with a serial number of the page in which such image was present originally. Thus the page layout is not destructed in pages other than the page of image deletion, and the user can easily confirm later the image existed in such page.

This is a continuation of U.S. patent application Ser. No. 11/216,130,filed Sep. 1, 2005, now allowed.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an editing of a digital document suchas a digital album, a digital presentation or a digital documentconstituted of plural pages and containing an image, a text or a patternin each page.

2. Related Background Art

An editing operation of a digital album has been executed, on a personalcomputer, by executing a program installed therein and by positioning animage, a character train and a pattern on a virtual page of a digitalalbum.

In a prior digital album editing, in case, after an image positioning ina virtual page, a new image is added to such virtual page beyond animage amount predetermined for such virtual page, such excessive imageis deleted from such virtual page and is positioned in an existing nextvirtual page. In such case, the image positioning in such existing nextvirtual page and in existing pages is changed irrespective of theintention of the user. Therefore the user is required to execute againthe image positioning in thus changed pages.

Otherwise, in such case in the prior digital album editing, theexcessive image is positioned not in an existing page but in a newvirtual page, which is created next to the virtual page to which theimage was first added. In such case, it is not possible to fix orrestrict the total page number of the digital album.

Also in the prior digital album editing, the digital album editingprogram no longer manages an image once an image deleted from a virtualpage of the digital album. Therefore the user, in case of wishing to usesuch deleted image again, is required to search a desired image from ahard disk of the personal computer, and suffers from insufficientoperability.

Also in the prior digital album editing, all the images designated bythe user are positioned on the virtual page. Therefore, in case the userdesignates a large number of images containing similar images, thevirtual page of the digital album may result in a drawback of showingrepeatedly similar images on the virtual page. The user is required toexecute a very cumbersome operation of finding similar images among theimages on the virtual page by visual observation and deletingunnecessary images.

SUMMARY OF THE INVENTION

An object of the present invention is, in an editing operation of adigital document constituted of plural virtual pages as represented by adigital album, to transmit, to the user in an easily understandablemanner, an image that is not positioned in the virtual page.

In an aspect of the present invention, the aforementioned object can beattained by a digital document editing method comprising an editing areadisplay step of displaying image data to be positioned in a page of adigital document, in an editing area; an image selecting step ofselecting one or more image data from the image data displayed in theediting area; a deletion instructing step of instructing a deletion ofselected image data from the page; and a display control step ofexecuting a display control, in response to the deletion instruction, todisplay the selected image data in an evacuation area and not to displayin the editing area.

Other features and advantages of the present invention will be apparentfrom the following description taken in conjunction with theaccompanying drawings, in which like reference characters designate thesame or similar parts throughout the figures thereof.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of the specification, illustrate embodiments of the invention and,together with the description, serve to explain the principles of theinvention.

FIG. 1 is a block diagram schematically showing a digital album editingsystem of the present invention;

FIG. 2 is a block diagram showing a configuration of a PC of the presentinvention;

FIG. 3 is a view showing a functional configuration of a digital albumediting program of the present invention;

FIG. 4 is a view showing a configuration of image data of the presentinvention;

FIG. 5 is a view showing a configuration of an image data assignmenttable of the present invention;

FIG. 6 is a view showing a configuration of a layout file of the presentinvention;

FIG. 7 is a view showing layout data in a layout list of the presentinvention;

FIG. 8 is a flow chart showing a process of editing a digital album byexecuting a digital album editing program on a PC of the presentinvention;

FIG. 9 is comprised of FIGS. 9A and 9B are flow charts showing a processof editing a digital album by executing a digital album editing programon a PC of the present invention;

FIG. 10 is a view showing a configuration of digital album data of thepresent invention;

FIG. 11 is a view showing a digital album editing frame of the presentinvention;

FIG. 12 is a view showing a layout data selecting frame of the presentinvention;

FIG. 13 is a view showing a digital album editing frame of the presentinvention;

FIG. 14 is a view showing a digital album editing frame of the presentinvention;

FIG. 15 is a view showing a change notifying dialog of the presentinvention;

FIG. 16 is a view showing a warning dialog of the present invention;

FIG. 17 is a view showing a digital album editing frame of the presentinvention;

FIG. 18 is a flow chart showing a process of editing a digital album byexecuting a digital album editing program on a PC of the presentinvention;

FIG. 19 is a flow chart showing a process of editing a digital album byexecuting a digital album editing program on a PC of the presentinvention;

FIG. 20 is a flow chart showing a process of editing a digital album byexecuting a digital album editing program on a PC of the presentinvention;

FIG. 21 is a view showing a digital album editing frame of the presentinvention;

FIG. 22 is a view showing an image selecting frame of the presentinvention;

FIG. 23 is a view showing an image selecting frame of the presentinvention;

FIG. 24 is a view showing an image selecting frame of the presentinvention from grouped images;

FIG. 25 is a view showing a digital album editing frame of the presentinvention; and

FIG. 26 is a view showing a digital album editing frame of the presentinvention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS First Embodiment

FIG. 1 is a view showing a configuration of an information providingsystem of the present embodiment.

Referring to FIG. 1, 101 denotes an image input apparatus serving toconvert an optical image, which is image information, into an electricalsignal and, after a predetermined image processing, record and reproducesuch signal as digital information. The image input apparatus 101 isconstituted for example of a digital still camera, a digital videocamera or a scanner. 102 denotes a personal computer to be operated bythe user. 103 denotes a data transfer interface for transferring imagedata, acquired in the image input apparatus 101, to the user PC 102. Thedata transfer interface 103 is constituted of a wired interfacerepresented by USB (universal serial bus) or IEEE1394, or a wirelessinterface represented by IrDA or Bluetooth. The image data transferredfrom the image input apparatus 101 through the data transfer interface103 to the user PC 102 are stored in a hard disk (HDD) of the user PC102. The image data transfer from the image input apparatus 101 to theuser PC 102 includes a case where the image input apparatus 101collectively transfer the image data stored in a memory apparatus,according to a command from an operating system (OS) installed in theuser PC 102 or an exclusive software, and a case where an OS or anexclusive software of the user PC 102 secures, according to a transfercommand transmitted from the image input apparatus 101 to the user PC102, a data recording area in the HDD of the user PC 102 and receivesthe image data from the image input apparatus 101.

The user PC 102 is capable of operating a browser having a standardprotocol capable of information transfer by an internet 104. The user PC102, by operating the browser 120, is capable of accessing to aphotosite 105 by a protocol such as Hyper Text Transfer Protocol (HTTP),obtaining and analyzing Web page information prepared with a descriptionlanguage such as Hyper Text Markup Language (HTML) or extensible MarkupLanguage (XML), and displaying a Web page on a display of the user PC102. Such Web page information is linked with multimedia informationsuch as an image and audio signals which the photosite 105 manages in animage DB 107.

Also the user PC 102, by operating the browser 120, is capable ofdownloading a template and image data of a digital album, to be used inexecuting a digital album editing program, from the photosite 105through the internet 104. The template and image data, to be downloaded,of the digital album are stored in the image DB 107.

The user PC 102 is further provided with a digital album editing programfor positioning and editing one or more image data on a digital albumcontaining one or more pages. The image data to be contained in thedigital album include those obtained from the image input apparatus 101and stored in the HDD of the user PC 102 and those downloaded from thephotosite 105.

Also the user PC 102 can request a print order of the edited digitalalbum to a print site 109 through the photosite 105. The print site 109executes a printing operation of the digital album data by a printer111, thereby outputting an album 112. FIG. 1 illustrates only one printsite 109, but it may be present in plural units.

FIG. 2 is a schematic view showing a configuration of an informationprocessing apparatus corresponding to the user PC 102 in the presentembodiment.

In FIG. 2, a CRT (cathode ray tube) display 201 displays, on a displayframe thereof, editing information such as a document, a pattern or animage, under editing, and user interface information such as an icon, amessage or a menu. A VRAM 202 generates an image to be displayed on thedisplay frame of the CRT display 201. The image data generated in theVRAM 202 are transferred according to a predetermined rule to the CRTdisplay 201, which thus displays an image thereon. A bit move unit (BMU)203 controls a data transfer between memories (for example between VRAM202 and another memory), or a data transfer between a memory and an I/Odevice (for example a network interface 211). A keyboard 204 includesvarious keys for inputting a document and the like. A pointing device205 is used for designating an icon, a menu or another object displayedon the display frame of the CRT display 201. A central processing unit(CPU) 206 controls various devices connected thereto, according to acontrol program stored in a read-only memory (ROM) 207, a hard disk(HDD) 209 or a compact disk (CD). A ROM 207 stores various controlprograms and data. A random access memory (RAM) 208 has a work area forthe CPU 206, an evacuation area for data in an error process, and a loadarea for the control programs. An HDD 209 can store various controlprograms and contents to be used in the user PC 102. For example, theHDD 209 stores a browser 120, digital album data, and a digital albumediting program. A compact disk drive (CD) 210 controls an access to acompact disk. A network interface 211 executes a communication withanother information processing apparatus, a printer and the like throughthe internet 104. A CPU bus 212 includes an address bus, a data bus anda control bus. A control program to the CPU 206 may be provided from theROM 206, HDD 209 or CD 210, or from another information processingapparatus through the network interface 211 and the internet 104.

FIG. 3 is a block diagram showing a functional configuration of adigital album editing program of the present embodiment. There areprovided a data control unit 301 for managing digital album data and anentire digital album editing program; a GUI control unit 302 forcontrolling a graphical user interface (GUI) of the digital albumediting program, thereby providing the user with operating means anddisplay means for the edited contents; a design control unit 303 formanaging design information such as a template file, a layout file 308,and an image data assignment table 309 to be used for the editing of thedigital album data; and a communication control unit 304 for preparingprint data, required for a print order, based on the edited digitalalbum data and executing a communication process for the print data andinformation necessary for the print order.

The digital album data managed by the data control unit 301 includecover image data 305 assigned to a cover of a digital album, paginalimage data 306 assigned to each page of the digital album, andextrapaginal data 307 not assigned to a page of the digital album. Theextrapaginal data 307 are so controlled as to be displayed on anevacuation image display area in a digital album editing frame to beexplained later. The layout file 308 records information for determininga position of image data in opened pages of the digital album and of acharacter train associated with the image data. The image dataassignment table 309 records, as a table, information on an amount ofimages, managed by the design control unit 303 and assigned to eachopened page of the digital album. In the present embodiment, a digitalalbum is constituted of a cover page and main pages, which aredistinguished and processed separately, but the present invention isalso applicable to a case where the cover page and the main pages arenot distinguished but processed similarly.

FIG. 4 shows a data configuration of the paginal image data 306 and theextrapaginal image data 307. Image data file 402 or 412 for the paginalimage data 306 or the extrapaginal image data 307 may be file data, or apath indicating a storage position of file data. Character data 403, 413contain character data associated with the image data. Image editinginformation 404, 414 contains an editing content applied to the imagedata. The editing content can be, for example, a clipping, a regulationof a color or a contrast, or a rotational operation. Page information415 contains information on a page, in which the image data have beenmoved from an editing area of such page to the evacuation image displayarea. A value stored in the page information 415 is displayed togetherwith the image data, on the evacuation image display area.

FIG. 5 is a view showing an example of an image data assignment table309 in the present embodiment. A number of images assigned to each mainpage of the digital album is determined, utilizing the image dataassignment table 309, based on a total number of main pages of thedigital album, and a number of images selected to be included in thedigital album. The image data assignment table 309 is present for everytotal number of the main pages of the digital album. In the following,for the purpose of easier understanding, there will be explained animage data assignment table 309 for 12 main pages in total, withreference to FIG. 5. According to the image data assignment table 309shown in FIG. 5, for 8 images selected to be included in the digitalalbum, 1 image is assigned in page 1, 2 images in pages 2 and 3, L imagein pages 4 and 5, 2 images in pages 6 and 7, 1 image in pages 8 and 9,and 1 image in pages 10 and 11, and no image data are assigned to a page12.

The image data selected to be included in the digital album are assignedaccording to an order arbitrarily selected by the user, an order ofselection of the image data, an order of photographing dates of theimage data, or an order of names of the image data.

In the present embodiment, there is explained a case of positioning theimages, selected to be included in the digital album, on both pages inan opened state, but the present invention is likewise applicable alsoto a case where the images are positioned on each page at a side.

FIG. 6 is a view showing a configuration of a layout file 308 of thepresent embodiment. The layout file is present for every total number ofthe main pages of the digital album. In the following, for the purposeof easier understanding, there will be explained a layout file for 12main pages in total, with reference to FIG. 6.

The layout file 308 shown in FIG. 6 is for 12 main pages in total. Alayout list for a cover page, a layout list for page 1 and a layout listfor last page 12 are constructed to position images on a page at oneside. Remaining layout lists for pages 2 and 3, pages 4 and 5, . . .pages 10 and 11 are constructed for two pages in an opened state. Thelayout list for the cover page has layout lists respectivelycorresponding to 1 image and 2 images. Also the layout list for the mainpage 1 has layout lists respectively corresponding to 1, 2 and 3 images.Also the layout list for the last page 12 has layout lists respectivelycorresponding to 1, 2, 3 and 5 images. Similarly, each layout list forpages 2 and 3, pages 4 and 5, pages 6 and 7, . . . or pages 10 and 11has layout lists corresponding to optimum number of images.

Also each of layout lists 602-615 has one or more layout data for eachnumber of images. FIG. 7 shows an example of the layout data held by thelayout list. FIG. 7 indicates that there are, for a certain page,provided layout lists corresponding to 1-5 images and each layout listincludes 2 or 3 layout data. The layout lists are classified into layoutdata A 701, layout data B 702 and layout data C 703. In the presentembodiment, the layout data A are taken as a default value. FIG. 7 showsa case of having 3 layout data, but such number is not restricted.

An image arrangement on each page is determined by a number of imagesassigned to such page and by layout data of the corresponding layoutlist. For example, in case 3 images are assigned to pages 2 and 3, 3images are positioned on the pages 2 and 3, according to positionsdesignated by layout data contained in the 3-image layout list 609 forthe pages 2 and 3.

However, the layout file 308 does not have, on each page, layout listscorresponding to all the number of the images. For example, the layoutfile for the pages 2 and 3 has, as shown in FIG. 6, the layout listscorresponding to 1, 2, 3, 6 or 8 images, but does not have thosecorresponding to 4 or 7 images.

The user PC 102 executes the digital album editing program, utilizingthe image data assignment table 309 and the layout file 308 anddetermines the assignment of image data on each page and an arrangementof such image data, thereby preparing a digital album.

In the editing operation of a digital album in the present embodiment byexecution of the digital album editing program, read from the HDD 209,by the CPU 206 of the user PC 102, there will be explained, withreference to FIG. 8, an operation of erasing an image, provided in anyof the pages, from such page and displaying such image on an evacuationarea.

A step S801 selects and determines an album size and a total number ofmain pages. The album size is for example an A4 or B5 size,corresponding to a sheet size of an album 112 outputted by the printer111 based on the digital album data.

A step S802 selects and determines a template file to be applied to thedigital album.

A step S803 causes the design control unit 303 to fetch a layout file308, correlated with the template file determined in the step S802, andthe image data assignment file 309.

A step S804 selects image data to be included in the digital album. Aselectable range of the number of the images is set according to thetotal number of main pages determined in the step S301 and the imagedata assignment table 309 fetched in the step S303. Also there isselected cover image data 305 to be positioned in the cover page of thedigital album. Then the data control unit 301 stores a copy of theselected image data in a memory area designated by the digital albumediting program.

A step S805 positions, on the cover page of the digital album, the coverimage data 305 selected in the step S804. At first the layout file 308is read based on the total number of the main pages determined in thestep S801. Then, according to the number of cover image data 305selected in the step S804, a cover layout list 602 or 603 is determined.According to default layout data contained in thus determined coverlayout list 602 or 603, the cover image data 305 are positioned on thecover page. The cover includes a front cover and a rear cover.

A step S806 positions, on each main page in the digital album, paginalimage data 306 selected in the step S804. At first the image dataassignment table 309 is read, based on the total number of main pagedetermined in the step S801 and the total number of the paginal imagedata 306 selected in the step S804. Then, according to thus read imagedata assignment table 309, the image data are assigned to each main pageof the digital album. Then the layout file 308 is read based on thetotal number of main pages determined in the step S801. Then a layoutlist is determined for each page, according to the number of the paginalimage data 306 assigned to each page. Then, according to default layoutdata of the layout list for each page, the paginal image data 306 arepositioned on each main page of the digital album. The positioningprocess for the paginal image data 306 is executed for all the mainpages. The paginal image data 306 are not positioned in a page on whichthe paginal image data 306 are not assigned according to the image dataassignment table 309. Then a digital album editing frame 1101 to beexplained later, is displayed, as shown in FIG. 11, on the CRT 201 ofthe user PC 102.

A step S807 executes an editing of characters to be recorded in thedigital album, such as an input process of a character trainrepresenting a comment on the image data, and a selection of a font, afont color and a font size of the inputted character train.

A step S808 executes a layout changing process such as an image exchangein each page of the digital album, an image addition to a page, an imagedeletion from a page, a change in the arrangement within a page. Suchlayout changing process will be explained later in more details withreference to FIG. 9.

Then a step S809 executes a process of confirming whether thus prepareddigital album data satisfy a form and conditions for a print order. Morespecifically, there is confirmed whether the cover page, contained inthe digital album data, and the paginal image data, displayed in themain page editing area, have an enough resolution for printing.

A step S810 prepares print data necessary for an album print order,based on the digital album data. The print data are used for instructinga printing of the paginal image data, positioned on each page of thedigital album, in a same arrangement also on a physical album.

A step S811 transmits the print data prepared in the step S810 and orderinformation necessary for a print order, to the photosite 105, whichtransfers such information to the print site 109.

A step S812 confirms whether the digital album data are to be stored.

In case the storage of the digital album data is confirmed in the stepS812, a step S813 stores the prepared digital album data in the HDD 209of the user PC 102.

FIG. 10 is a data structure view showing a data configuration of thedigital album data to be stored. There are shown entire digital albumdata 1001, an area 1002 for storing paginal image data 306, each paginalimage data 1003 (306), an area 1004 for storing extrapaginal image data,each extrapaginal image data 1005 (307), an area 1006 for storing layoutdata used for arrangement in each main page, and such layout data 1007.The layout data 1007 may further include an order of arrangement of theimage data in each page, a number of the image data, a position of theimage data and a frame position for indicating a character trainassociated with the image data.

In the present embodiment, as the extrapaginal image data 307 areincluded in the digital album data, the image data not registered as thepaginal image data are displayed also at a re-editing of the digitalalbum, so that the user can easily confirm the image data that werejudged as unnecessary in the previous editing.

FIGS. 9A and 9B are flow charts showing a layout changing process to beexecuted in the step S808 in FIG. 8.

A step S901 discriminates whether a page layout change has beeninstructed by the user. The page layout change includes, for example, anexchange of the image data positioned on a page of the digital album, anaddition or a deletion of image data to or from a page, a transfer ofimage data from a page to another, and a change in the selection of thepage layout data.

In FIG. 11, there are shown a digital album editing frame 1100; a mainpage editing area 1101 displaying a page under editing; an evacuationimage display area 1102 for displaying image data which are selected inthe step S804 but are not assigned in a page in a later editingoperation; and a page list display area 1103 for displaying all the pagenumbers contained in the digital album. In the page list display area1103, a page under editing is indicated by emphasizing the page numberof such page.

FIG. 11 shows, as an example, a state where the main page under editingis pages 6 and 7, and, in the main page editing area 1101, images A, Band C are arranged according to 3-image layout data for the pages 6 and7. Also page numbers of the pages 6 and 7 are displayed in an emphasizedstate in the page list display area 1103. Also the evacuation imagedisplay area 1102 displays an image D that is not assigned to the pageas a result of the editing operation.

In FIG. 11, the page list display area 1103 only displays page numbers,but it is also possible display thumbnail image representing an image oneach page.

An instruction 1104 is displayed in response to a right click of thepointing device 205 on the main text editing area 1101.

In an initial image of the digital album editing frame 1100 displayed inthe step S806, the image D is not present in the evacuation imagedisplay area 1102.

A step S911 discriminates whether the page layout change instruction hasbeen a “change of page layout data”. More specifically, when the userexecutes a right clicking operation of the pointing device 205 on themain page editing area 1101, the instruction list 1104 is displayed, andwhen the user selects, by the pointing device 205, “layout change” fromthe instruction list 1104, it is identified that “change of page layoutdata” has been instructed.

In case the step S911 identifies that the instruction of the page layoutchange is “change of page layout data”, a step S912 detects a number ofimages displayed on the main page editing area 1101.

A step S913 obtains a layout list corresponding to the number of imagesdetected in the step S912.

A step S914 discriminates whether the layout list, obtained in the stepS913, contains two or more layout data.

In case the step S914 identifies that the layout list contains two ormore layout data, a step S915 displays the layout data, contained in thelayout list, on a layout data selecting frame 1200 as shown in FIG. 12.FIG. 12 shows an example where the main page editing area is detected tocontain three images. FIG. 12 shows layout data 1201 of three kinds,contained in the layout list. There are also provided an OK button 1203and a cancel button 1204, and a depression of the OK button 1203 selectsand determines layout data which are turned on in a check box 1201,whereupon the layout data selecting frame is no longer displayed. Also adepression of the cancel button 1204 terminates the change of the pagelayout data, whereupon the layout data selecting frame is no longerdisplayed. The displayed layout data 1201 include the layout datautilized for positioning the image data in the main page editing area1101, and, in case the layout data utilized for the current positioningof the image data are again selected, the sequence may be terminatedwithout executing an ensuing process. Also the layout data utilized forthe current image positioning may be excluded from the display of thelayout data 1201.

A step S916 selects, among the layout data 1201 in the layout dataselecting frame 1200 displayed in the step S915, layout data of which acorresponding check box is turned on.

A step S917 positions the paginal image data 306 displayed in the mainpage editing area 1101, according to the layout data selected in thestep S916.

In case the step S914 identifies that two or more layout data are notpresent, a step S902 displays a warning dialog. FIG. 16 shows an exampleof the warning dialog.

A step S921 discriminates whether the page layout changing instructionis “an image data addition to the page”. More specifically, when theuser instructs, with the pointing device 205, to move an image displayedin the evacuation image display area 1102 to the main page editing area1101 as shown in FIG. 13, there is identified an instruction for “animage data addition to the page”. FIG. 13 shows a concept of operationthat the user selects an image. C from the images B, C and D displayedin the evacuation image display area 1102 and instructs an addition tothe main page editing area by a drag-and-drop operation. It is alsopossible, in the images displayed in the evacuation image display area1101, to select plural images at the same time.

A step S922 calculates a sum of a number of the images displayed on themain page editing area 1101 and a number of the images instructed in thestep S921 for addition.

A step S923 discriminates whether a layout list, corresponding to thesummed number detected in the step S922, is present.

In case the step S923 identifies that such layout list is present, astep S924 obtains such layout list.

A step S925 selects and determines default layout data in the layoutlists obtained in the step S924.

A step S926 positions the image data instructed for addition in the stepS921 and the images already displayed in the main page editing area,according to the layout data determined in the step S925. FIG. 14 showsan example of the image frame after such positioning. FIG. 14 shows acase where an image C is added to a state in which an image A ispositioned according to 1-image layout data as shown in FIG. 13, wherebytwo images in total are displayed on the main page editing area 1101 andare arranged therein according to 2-image default layout data for thepages 6 and 7. FIG. 14 also shows that the evacuation image display area1102 no longer displays the image C. In this state, the data controlunit 301 re-registers the image C as paginal image data 306 instead ofextrapaginal image data 307.

In the present embodiment, the image data for addition are selected fromthose displayed in the evacuation image display area 1102, but suchselection may also be made from the image data stored in the HDD 209 ofthe user PC 102, the image data held in an application program otherthan the digital album editing program, or the image data stored in theimage DB 107 of the photosite 105.

A step S931 discriminates whether the page layout changing instructionis “an image data deletion from the page”. More specifically, when theuser instructs, with the pointing device 205, to move an image displayedin the main page editing area 1101 to the evacuation image display area1102, there is identified an instruction for “an image data deletionfrom the page”. Otherwise, when the user executes a right clickingoperation of the pointing device 205 on the main page editing area 1101,the instruction list 1104 is displayed, and when the user selects, bythe pointing device 205, “deletion” from the instruction list 1104, itis identified that “an image data deletion from the page” has beeninstructed.

A step S932 causes the data control unit 301 to renew a registration ofthe image data instructed for deletion from the page in the step S931.In case the image of such image data is instructed to be moved to theevacuation image display area 1102, the registration for such image dataas paginal image data 306 is renewed as extrapaginal image data 307, andsuch image data are displayed in the evacuation image display area 1102.On the other hand, in case the deletion of the image data is instructedby selecting “deletion” from the page layout change instruction list1104, the image data are erased from the memory area on the HDD 209,managed by the data control unit 301.

A step S933 calculates a remainder of a number of the images displayedon the main page editing area 1101 after subtracting therefrom a numberof the images instructed in the step S931 for deletion.

A step S934 discriminates whether a layout list, corresponding to theremainder calculated in the step S933, is present.

In case the step S934 identifies that such layout list is present, astep S935 obtains such layout list.

A step S936 selects and determines default layout data in the layoutlists obtained in the step S935.

A step S937 positions the image data after excluding the image datainstructed for deletion in the step S931 from the images alreadydisplayed in the main page editing area, according to the layout datadetermined in the step S936.

It is also possible, in the step S924 or S935, to notify the user of achange in the image arrangement displayed in the main page editing area1101, by displaying a change notifying dialog on the CRT display 201 ofthe user PC 102. An example of such dialog image is shown in FIG. 15. InFIG. 15, the user is notified of image arrangements 1501 before andafter the change, and a message 1504 indicating that the image isdisplayed in the evacuation image display area 1102. In response to adepression of an OK button 1503 by the user with the pointing device205, the change notifying dialog frame is no longer displayed and theimage arrangement is changed according to the newly selected layoutdata.

Also in case the step S923 or S934 identifies that the correspondinglayout list is not present, the sequence proceeds to a step S903 forobtaining a layout list containing a largest number of images less thanthe detected number in case of the process of the step S923, or a layoutlist containing a minimum number of images larger than the detectednumber in case of the process of the step S934.

Then a step S904 calculates a difference between the number of images ofthe layout list obtained in the step S903 and the number of imagesdetected in the step S922 or S933.

Then the step S905, in case of a process from the step S923, selects anumber of images, calculated in the step S904, from the imagesinstructed for movement to the main page editing area 1101, and displayssuch selected images in the evacuation image display area 1102. Theimages to be added are displayed in the main page editing area 1101.Also there may be displayed a dialog indicating that the imagesdisplayed in the main page editing area 1101 are changed for display inthe evacuation image display area 1102.

Also in case of a process from the step S934, the step S905 displays theimages, including a margin, in the main page editing area 1101,according to the layout data of the obtained layout list correspondingto the number of images. Also there is displayed a dialog requesting animage addition in the page in order to fill the margin.

Also in the present embodiment, it is also possible, before executingthe process of the step S921, S922 or S933, to obtain the numbers ofimages for which the layout lists are available for the page displayedon the main page editing area 1101, and to display such numbers on thedigital album editing frame 1100. In this manner, the user can know inadvance changeable number of the images.

According to the present embodiment, as explained in the foregoing, animage deleted from a certain image is displayed in the evacuation area,whereby an image layout in other pages is not influenced.

Also as an image deleted from a certain image is displayed in theevacuation area, in case of including an image that has been erased fromthe page again into the page, the user can easily select such image.

Second Embodiment

In the present embodiment, there will be explained an operation, in thedigital album editing frame 1100 displayed for editing an digital album,of displaying, together with an image, a page number in which the imageexisted before evacuation, on the evacuation area 1102. In thefollowing, parts same as those in the first embodiment will not beexplained and parts featuring the present embodiment only will beexplained in detail.

FIG. 17 shows a digital album editing frame 1101 of the presentembodiment, displayed for executing an editing operation on the digitalalbum. The digital album editing frame 1101 shown in FIG. 17 displays,in addition to the items shown in FIG. 11, a page number 1704 beforeevacuation. The page number 1704 before evacuation is a number of a pagein which the extrapaginal image data 307 were assigned before.

In the following, the procedure will be explained with reference to FIG.18.

A step S1801 reads and obtains, from the HDD 209, data on a page numberin which the extrapaginal image data 307 were assigned before.

A step S1802 displays, in the evacuation image area 1102, theextrapaginal image data 307 together with the before-evacuation pagenumber 1704, based on the data obtained in the step S1801. Theevacuation image display area 1102 shown in FIG. 17 displays an image Dthat was assigned on pages 2 and 3 but is not assigned on pages by asubsequent editing operation, and images B and C that were assigned onpages 6 and 7 but are not assigned on pages by a subsequent editingoperation.

A step S1803 discriminates whether a depressing operation on thebefore-evacuation page number 1704 has been executed by the user.

In case the step S1803 identifies that the depressing operation has beenexecuted, a step S1804 displays a page of the before-evacuation pagenumber 1704 in the main page editing area 1101. The images B and D, ofwhich the before-evacuation page numbers 1704 belong to pages 6 and 7,are displayed in an emphasized manner in the evacuation image displayarea 1102.

The present embodiment, as explained above, allows to easily understandthe page in which the image displayed in the evacuation area existedbefore, and to easily confirm the current layout of the page in whichsuch image existed before.

Third Embodiment

In the present embodiment, there will be explained an operation, in thecourse of reading and executing a digital album editing program from theHDD 209 by the CPU 206 of the user PC 102 and in case the imagesdesignated by the user include mutually similar images, of positioningone of such similar images on a page of the digital album andpositioning the remainder of the similar images in an evacuation areadifferent from the page.

In the following, parts same as those in the first or second embodimentwill not be explained and parts featuring the present embodiment onlywill be explained in detail.

FIG. 19 is a flow chart showing a process flow of editing a digitalalbum by the CPU 206 of the user PC 102, by reading and executing adigital album editing program from the HDD 209.

At first there are executed processes of steps S1901-S1904, which aresame as those of the steps S801-S804 of the first embodiment shown inFIG. 8.

Then a step S1941 discriminates whether or not to group similar imagedata, contained in the image data selected in the step S1904.

FIG. 22 shows an example of the image selecting frame displayed, in thestep S1904, for selecting the images to be positioned in the digitalalbum. The user enters following selections or instructions by using apointing device on an image data selecting frame 2200. 2201 denotes adirectory structure display area, for displaying a file directorystructure of the HDD 209 of the user PC 102. The user selects adirectory containing the image data to be used in the digital album,according to a display of the directory structure display area 2201. Athumbnail image display area 2202 is provided for a list display ofthumbnail images of the image data present in the directory selected bythe directory structure display area 2201. Among the thumbnail imagesdisplayed in the thumbnail image display area 2202, a thumbnail image2203 of the image data A1 is emphasized by a frame line, indicating aselection by the user. An operation menu 2204 is displayed uponselecting the thumbnail image A1 on the thumbnail image display area2202. When the user selects a menu item “grouping similar images” in theoperation menu 2204, an instruction for a grouping of the image datasimilar to the image data A1 is identified.

A step S1942 searches image data, similar to the image data A1corresponding to the thumbnail image A1, from the image data selected inthe step S1904.

More specifically, image data having a photographing time within apredetermined range with respect to the photographing time of the imagedata A1 (for example within 5 minutes before or after the photographingtime of the image data A1) are searched as the similar image data.Otherwise, image data containing a facial image matching the facialimage extracted from the image data A1 are searched as the similar imagedata. Otherwise, as described in U.S. Pat. No. 6,400,853, similar imagedata are searched based on a feature amount of the image data A1. In thepresent embodiment, a searching method for the similar image data is notparticularly restricted.

A step S1943 executes a grouping of the image data searched in the stepS1942 and the image data A1 constituting the object of search. Morespecifically, the grouping can be achieved by giving each of the imagedata searched in the step S1942 and the image data A1 constituting theobject of search an identifier for identifying a group to which suchimage data belong and storing such data in the HDD 209. The CPU 206 canjudge the grouping of the image data by referring to the groupidentifier of the image data stored in the HDD 209. Otherwise, thegrouping may be achieved by providing the HDD 209 with a table forgrouping management, and storing an identifier for uniquely identifyingthe image data searched in the step S1942 and the image data A1constituting the object of search. The CPU 206 can judge the grouping ofthe image data by referring to the group management table stored in theHDD 209.

FIG. 23 shows an example of a similar image data search result frame2300. A frame 2305 indicates that the image data A1-A4 are grouped as aresult of search in the step S1942. The grouped image data arerearranged in the thumbnail image display area 2202, so as to becollected in the grouping frame 2305.

A step S1944 causes the data control unit 301 to renew the database, insuch a manner that the image data A1 constituting the object of searchbecome a representative of the similar image data and are managed aspaginal image data 306, while the image data A2, A3 and A4 m groupedwith the image data A1 are managed as extrapaginal image data 307.Within the image data selected in the step S1902, those not grouped areprocessed as paginal image data 306. In the foregoing, the image data A1constituting the object of search are automatically made therepresentative of the similar image data, but such method is notrestrictive and the image data selected by the user from the groupedsimilar image data may be made the representative of the similar imagedata. Otherwise, within the grouped similar image data, those having alatest, earliest or intermediate photographing time may be selected asthe representative of the similar image data.

Then there are executed processes of steps S1905-S1907, which are sameas those of the steps S805-S807 of the first embodiment shown in FIG. 8.

Then a step S1908 executes a replacing process of the representative ofthe similar image data in each main page of the digital album with thegrouped similar image data. Such replacing process of the similar imagedata will be explained in detail later, with reference to FIG. 20.

Then there are executed processes of steps S1909-S1913, which are sameas those of the steps S809-S813 of the first embodiment shown in FIG. 8.

The digital album stored in the step S1913 has a configuration same asthat of the first embodiment shown in FIG. 10. The present embodiment isparticularly characterized in that the extrapaginal image data 1004include similar image data that are not included in the page.

In the present embodiment, since the digital album data 1001 include theextrapaginal image data 307, the similar image data that are notincluded in the page at the re-editing of the digital album are alsoread and displayed in the evacuation image display area, whereby thesimilar image data that are not included in the digital album in theprevious editing can be easily confirmed.

FIG. 20 is a flow chart showing a similar image data replacing processto be executed in the step S1908 of the present embodiment, shown inFIG. 19.

A step S2001 discriminates whether a similar image data replacingprocess has been instructed.

FIG. 21 shows an example of a digital album editing frame 2100 displayedon the CRT 201 of the user PC 102. There are shown a main page editingarea 2101 for displaying a page under editing; an evacuation imagedisplay area 2102 for displaying image data designated as theextrapaginal image data in the step S1944; and a page list display area2103 for displaying all the page numbers contained in the digital album.In the page list display area 2103, a page under editing is made clearby an emphasized display of the page number of such page. FIG. 21 shows,as an example, a state where the main page under editing is pages 6 and7, and, in the main page editing area 2101, image data A1, B and C arearranged according to 3-image layout data for the pages 6 and 7. Alsopage numbers of the pages 6 and 7 are displayed in an emphasized statein the page list display area 2103. Also the evacuation image displayarea 2102 displays an image D that is not assigned to the page as aresult of the editing operation by the user, and image data A2, A3 andA4 assigned as extrapaginal image data 307 in the step S1944. The imagedata A2, A3 and A4 are surrounded by a similar image frame 2106. In aninitial state of the digital album editing frame 2100 displayed in thestep S1906, the evacuation image display area 2102 does not show theimage data D but only include the image data A2, A3 and A4 assigned asextrapaginal image data 307 in the step S1944.

An instruction list 2104 is displayed in response to a right clickingoperation of the pointing device 205 on the image data 2105 displayed inthe main page editing area 2101. When “select from grouped image” isselected in the instruction list 2104, it is identified in the stepS2001 that a similar image data replacing process has been instructed.

In the instruction list 2104, an item “select from grouped image” may bedisplayed only in case the selected image data 2105 have similar imagedata. Otherwise such item may be displayed even when the image data 2105without similar image data are selected and in case an item “select fromgrouped image” is selected, the absence of the grouped image may beinformed by a dialog or the like.

It is also possible, within the image data displayed on the main pageediting area 2101, to execute an emphasized display on those havingsimilar image data.

It is also possible, in response to the selection of the item “selectfrom grouped image” in the instruction list 2104 displayed on the imagedata A1 (2105), to execute a highlighted display of the image data A2,A3 and A4 in the evacuation image display area 2102, grouped with theimage data A1.

In FIG. 21, the page list display area 2103 only displays page numbers,but it is also possible display thumbnail image representing an image oneach page.

In case the step S2001 identifies an instruction for a similar imagedata replacing process, a step S2002 displays a group image selectingframe 2400 as shown in FIG. 24. In FIG. 24, there are shown thumbnailimages 2401-2404 of the grouped image data A1-A4; areas 2405-2408 fordisplaying photographing dates of the image data; areas 2409-2412 fordisplaying comments for the image data; and check boxes 2413-2416 forselecting an image to be assigned to the main page. As the image data A1are currently assigned to the main page, the check box 2413 for theimage data A1 is shown in a turn-on state. There are also provided an OKbutton 2417 for instructing a replacement of the image datacorresponding to the turn-on check box among the check boxes 2413-2416with the grouped image data currently assigned to the main page; and acancel button 2418 for instructing a cancellation of the similar imagedata replacing process.

It is also possible, in response to a depressing operation by the useron the thumbnail images 2401-2404, to effect an enlarged display of theoriginal image of the corresponding image data. This method allows aneasier comparison of the images for the user.

A step S2003 discriminates whether an image replacement has beeninstructed.

In case the step S2003 identifies such instruction, a step S2004 obtainsimage data corresponding to the turned-on check box among the checkboxes 2413-2416.

Then a step S2005 displays the image data, obtained in the step S2004,in the main page editing area 2101 as the representative of the similarimage data, and displays the image data 2105, which are grouped with theabove-mentioned image data and which have been displayed in the mainpage editing area 2101, in the evacuation image display area 2101. Inthe evacuation image display area 2101, the grouped image data A2, A3and A4 are surrounded by a similar image frame.

FIG. 25 shows an example of the digital album editing frame 2101 afterthe image data replacement. In FIG. 25, the image data A2 are selectedfrom the similar image data and displayed in the main page editing area2101, in place for the image data A1 which were assigned to the mainpage and which are not displayed in the evacuation image area 2102.

Also the database is so renewed that the image data, which are shiftedfrom the main page editing area 2101 to the evacuation image area 2102,are managed as extrapaginal image data 308, and that the image data,which are shifted from the evacuation image area 2102 to the main pageediting area 2101, become the representative of the similar image dataand are managed as paginal image data 307.

In the present embodiment, the image data for replacement are selectedby the group image selecting frame 2400 as shown in FIG. 24, but suchmethod is not restrictive, and, for example in response to a selectionby the user of the image data A2 in the evacuation image area 2102 and adrag-and-drop operation into the main page editing area 2101, there maybe executed a replacement of the image data A2 with the image data A1which are grouped with the image data A2 and are displayed in the mainpage editing area 2101.

Otherwise, as shown in FIG. 26, in response to a selection by the userof the image data A2 in the grouped image data in the evacuation imagearea 2102 and a selection of an item “change image” in a displayedinstruction list 1608, there may be executed a replacement of the imagedata A2 with the image data A1 which are grouped with the image data A2and are displayed in the main page editing area 2101.

Also in response to a selection by the user of any one of the similarimage data displayed in the evacuation image area 2102, a pagecontaining representative of the similar image data correspondingthereto may become a subject of the editing and may be displayed in themain page editing area 2101.

In the present embodiment, it has been explained that only one imagedata are positioned in the main page among the plural image data groupedas similar image data, but such number is not limited, and may be anarbitrary number designated by the user or may be an arbitrary numberpreset in the digital album editing program.

The present embodiment, as explained in the foregoing, allows toprevent, in case the images designated by the user to be included in thedigital album include similar images, unnecessary inclusion of suchsimilar images in the digital album.

The embodiments have been explained in an example of the digital albumediting program, but the present invention is not limited to such caseand is likewise applicable to a digital document editing program such asan editing program for a digital presentation or a digital document,constituted of plural pages and containing an image, a text, a patternand the like in each page.

OTHER EMBODIMENTS

The objects of the present invention are naturally attained also bysupplying a system or an apparatus with a recording medium storingprogram codes of a software realizing the functions of theaforementioned embodiments and by reading and executing, by a computer(or a CPU or an MPU) of such system or apparatus, the program codesstored in the recording medium. In such case, the program codesthemselves read from the memory medium realize the functions of theaforementioned-embodiments, and the memory medium storing the programcodes constitutes the invention.

The memory medium for supplying the program codes can be, for example, afloppy disk (trade name), a hard disk, an optical disk, a magnetooptical disk, a CD-ROM, a CD-R, a magnetic tape, a non-volatile memorycard, a ROM or a DVD.

The present invention also includes, not only a case where the computerrealizes the functions of the aforementioned embodiments by executingthe read program codes, but also a case where an OS (operating system)or the like functioning on the computer executes all the actualprocesses or a part thereof under the instructions of such programcodes, thereby realizing the functions of the aforementioned

The present invention further includes a case where the program codesread from the memory medium are once stored in a memory provided in afunction expansion board inserted in the computer or a functionexpansion unit connected to the computer, and, under the instructions ofsuch program codes, a CPU or the like provided in the function expansionboard or the function expansion unit executes all the actual processesor a part thereof, thereby realizing the functions of the aforementionedembodiments.

The present invention is not limited to the above embodiments andvarious changes and modifications can be made within the spirit andscope of the present invention. Therefore to apprise the public of thescope of the present invention, the following claims are made.

This application claims priority from Japanese Patent Application Nos.2004-257256 and 2004-257257 filed on Sep. 3, 2004, which are herebyincorporated by reference herein.

What is claimed is:
 1. An electronic album editing apparatus comprising:a retrieval unit that retrieves image data which are similar to eachother, from a plurality of image data stored on a storage medium; adisplay control unit that controls a display to display a plurality ofimage data retrieved by the retrieval unit such that at least one of theplurality of retrieved image data is displayed as representative similarimage data in an editing area corresponding to a page of an electronicalbum and the plurality of retrieved image data other than therepresentative similar image data, comprising similar image data, aredisplayed in an evacuation area which is provided independently of thepage of the electronic album; a similar image designation unit thatdesignates the similar image data displayed in the evacuation area; anda replacement instruction unit that inputs a replacement instruction ofthe similar image data designated by the similar image designation unit,wherein in response to the input of the replacement instruction, thedisplay control unit controls the display to display the designatedsimilar image data in the editing area and display the representativesimilar image data related to the designated similar image data in theevacuation area.
 2. An apparatus according to claim 1, wherein theretrieval unit retrieves the image data which are similar to each other,on the basis of the photography date and time of the image data, a faceimage included in the image data, and a feature amount of the imagedata.
 3. An apparatus according to claim 1, wherein the display controlunit controls the display to display the representative similar imagedata separately from the other image data which are displayed in theediting area.
 4. An apparatus according to claim 1, further comprising asimilar image selection unit that selects the similar image datadisplayed in the evacuation area, wherein the electronic album includesa plurality of pages, and wherein the display control unit controls thedisplay to display, in the editing area, the page of the electronicalbum which includes the representative similar image data related tothe selected similar image data.
 5. An apparatus according to claim 1,further comprising a generation unit that generates print data forprinting the page in which the image data displayed in the editing areaare arranged.
 6. A control method of an electronic album editingapparatus, comprising: retrieving image data which are similar to eachother, from a plurality of image data stored on a storage medium;controlling a display to display a plurality of image data retrieved inthe retrieving step such that at least one of the plurality of retrievedimage data is displayed as representative similar image data in anediting area corresponding to a page of an electronic album and theplurality of retrieved image data other than the representative similarimage data, comprising similar image data, are displayed in anevacuation area which is provided independently of the page of theelectronic album; and designating the similar image data displayed inthe evacuation area; and inputting a replacement instruction of thesimilar image data designated by the similar image designation unit,wherein in response to the input of the replacement instruction, thecontrolling step includes controlling the display to display thedesignated similar image data in the editing area and display therepresentative similar image data related to the designated similarimage data in the evacuation area.
 7. A non-transitory computer-readablestorage medium storing a program comprising a program code for causing acomputer to execute the control method according to claim 6.